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REQUEST FOR WITHDRAWAL OF ERRONEOUS HOLDING OF ABANDONMENT 

Sir: 

It is respectfully requested that the holding of abandonment, documented in the Notice of 
Abandonment mailed July 18, 2005, be withdrawn as erroneous. 

The Notice of Abandonment states that this application is abandoned in view of Applicant's 
failure to timely file a proper reply to the Office letter mailed March 22, 2005 . The holding of 
abandonment is erroneous for at least two reason , as follows: 

1) The Office Action mailed March 22, 2005 sets a three month period for response , and so 
that period ended June 22, 2005. However, under 37 C.F.R. §1. 136(a) an extension of the period 
for response of up to an additional three months may be obtained . Thus, the application can not be 
deemed to be abandoned until after September 22, 2005 . and then only if no response has been 
filed to the March 22, 2005 Office Action . 

2) A response to the March 22, 2005 Office Action was filed June 22, 2005 . Attached are a 
copy of the response and a copy of the receipt postcard showing receipt of the response by the 
Patent and Trademark Office on June 22, 2005. 
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In view of the above, it is clear that the application has not been abandoned, and so it is 
respectfully requested that the holding of abandonment be withdrawn and the Amendment of June 
22, 2005 be considered. 



McGinn & Gibb, PLLC 

8321 Old Courthouse Road, Suite 200 

Vienna, VA 22182-3817 

(703) 761-4100 

Customer No. 21254 



Respectfully Submitted, 





V^ifr^ >^ Attorney's Post Card Filing Receipt 

Senal Number^?/,, - 7 g ^ p * ers „ £ ^^^^ 

Attorney's Docket Number:^- f pc f p | |^p atent □ 1Ylldenaik 

^e^ Jj^' ^ h + «~ Application Filing Date: A ^ 

<—* Notice of Appeal 

□ n 

□ ass* 



JUN 2 2 



' Request for Extension of Time . Q CPA Request 
Appeal Brief (in triplicate) Q Reply Brief 

1449 Form w/ DocumentsQl Priority Document(s) 

Recordation Cover Sheet □ Formal Drawings 
□ Drawing Corrections □ Issue Fee Transmittal □ Missing Parts 



rient 



Fees Filed ] 



Charge Deposit Account: 
Hand Delivered 




IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In re Application of: Hiroshi Ohta 

Serial No.: 09/781,280 Group Art Unit: 2623 

Filed: February 13, 2001 Examiner: Le, Brian Q. 

For: OBJECT EXTRACTION DEVICE, OBJECT EXTRACTION METHOD, AND 

RECORDING MEDIA FOR STORING AN OBJECT EXTRACTION PROGRAM 

Honorable Commissioner of Patents 
Alexandria, VA 22313-1450 

AMENDMENT UNDER 37 C.F.R. S1.1 1 1 

Sir: 

In response to the Office Action dated March 22, 2004, please amend the above-identified 
application as follows: 
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AMENDMENTS TO THE SPECIFICATION 

The paragraph commencing at page 10, line 9 is amended as follows: 
Fig. 2 is a block drawing showing the structure of the object extraction device 102 
according to the fiFst-second_embodiment of the present invention. 

The paragraph commencing at page 10, line 1 1 is amended as follows: 
Fig. 3 is a block drawing showing the structure of the object extraction device 103 
according to the fifst -third embodiment of the present invention. 



2 



Serial No.: 09/781,280 
Docket No. OSP- 10401 

AMENDMENTS TQ THE CLAIMS 

1 . (Currently amended) An object extraction device i comprising: 

a first object extraction calculating device that finds th^an object extraction image by 
carrying out object extraction calculations for extraction of an object by using a predetermined first 
calculation parameter on a plurality of photographed images having a parallax with respect to the 
same-object;-aad 

an incorrect outline extraction processing device that extracts an outline from wHteobject 
extraction image found by said first object extraction calculating device and extracts a^an incorrect 
outline segmenjn ntr n ight line segm en t having a length br ooding a pred etermine d th ie J i u ld valu e 
wrthift-from the extracted outline^ 

a recalculated region determining device that de t ermines as a recalculated repinn a p ^;,,! 

region that includes the incorrect outline segment extracted hv said incorrect outline extraction 
processing device within an image region o f one of the phot ographed ima^s; a»H 

* second object extraction calculating device that finds a re-extrac ted image that rompW^ 

an object extraction image of the recalcul ate d re gion bv carrvinp ou t an object evtra.ti™ 
calculation in order to eliminate the incorrect outline segment in th , recalculated re^pn bv us, np a 
second calculation parameter that is diff erent from the fi rst calculation p a rameter on saiH r hm .r«y 
of photographed images . 

2. (Currently amended) An object extraction device according to Claim 1 A wherein said 
incorrect outline extraction processing device comprises: 



3 



) ■) 

Serial No.: 09/781,280 
Docket No. OSP- 10401 

an outline extraction device that extracts aa-theputline from aa-the object extraction image 
found by said first object extraction calculating device; 

an edge pixel calculating device that finds tne-an_edge part of the object from a 
predetermined photographed image from among said-the plurality of photographed images; and 

an incorrect outline extraction device that extracts as a*-the_incorrect outline fee -segment a 
straight line segment &atjs_within the outline extracted by said outline extraction device, that istho 
comprises an outline part that does not include the edge part found by said edge pixel calculating 
device, and thatjias a length exceeding a predetermined threshold value. 

3. (Currently amended) An outline extraction device according to Claim 1, wherein said 
incorrect outline processing device comprises: 

an outline extraction device that extracts a»-the_outline from afl-the_object extraction image 
found by said first object extraction calculating device; 

an edge pixel calculating device that finds fee-an edge part of the object from a specified 
photographed image from among said-the_plurality of photographed images; and 

an incorrect outline extraction device that extracts as an incorrect outline fee -segment a 
straight line segment that is-fee^omprises an outline part within the outline extracted by said 
outline extraction device, that does not include the edge part found by said edge pixel calculating 
device, and thathas a length exceeding a predetermined threshold value 

4. (Currently amended) An object extraction device according to Claim 1, wherein said 
incorrect outline processing device comprises: 
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an outline extraction device that extracts aa-the outline from an-the object extraction image 
found by said first o bject extraction calculating device; 

an edge pixel calculating device that finds fee-an edge part of the object from a specified 
photographed image from among sa4d-the plurality of photographed images; and 

an incorrect outline extraction device that extracts as a«-the incorrect outline fee -segment 
{ala_straight line segment that is-fee -comprises an outline part within the outline extracted by said 
outline extraction device,, that does not include the edge part found by said edge pixel calculating 
device 1 and thathas a length exceeding a predetermined first threshold value^ and fee-(b_lastraight 
line segment that is-fee-comprises an outline part that intersects swd-the edge part found by fee-said 
edge pixel calculating device and thaUias a length exceeding a predetermined second threshold 
value. 

5 . (Currently amended) An object extraction device according to Claim-+_2, wherein said the 
straight line segment is a straight lino segment e xtends along the scanning direction of saW 
pr e determined aphotographed image. 

6. (Canceled) 

7. (Currently amended) An object extraction device according to Claim-6_1 , wherein said the 
recalculated region is determined as the comprises a rectangular region having a predetermined 
range that includes s«d-fee_incorrect outline segment . 
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8. (Currently amended) An object extraction device according to Claim-6_L wherein said 
recalculated region determining device re-determines as said-therecalculated region tbe-a_regi( 
that encompasses all of the overlapping recalculated regions instead of a plurality of said-fte 
overlapping recalculated regions. 



9. (Currently amended) An object extraction device according to Claim 8 A wherein said-the 
recalculated region that has been re-determined is determined as comprises t he rectangular region 
having the smallest area. 

10. (Currently amended) An object extraction device according to Claim-6_I, further 
comprising an image reconstructing device that reconstructs an image of the object extraetien 
image-based on the object extraction image found by said first object extraction calculating device 
and the re-extracted image found by said second object extraction calculating device. 

1 1 . (Currently amended) An object extraction device according to Claim 1 0, wherein said 
image reconstructing device reconstructs an image of the object extraction imago by exchanging 
the-an image in the-a region corresponding to said-the_recalculated region within the image region 
of the object extraction image found by said first object extraction calculating device and the re- 
extracted image found by said second object extraction calculating device. 

12. (Currently amended) An object extraction device according to Claim 1 l a wherein said-the 
second calculation parameter Comprises a calculation parameter that is used to carry out an object 
extraction calculation that is more sophisticated than said-the_first calculation parameter. 
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13. (Currently amended) An object extraction device according to Claim 1 1 , wherein said-the 
object extraction device is realized by comprises a small-scale computer. 

1 4. (Currently amended) An object extraction device according to Claim 1 , wherein said 
plurality of photographed images are photographed by a plurality of cameras that photograph the 
same-object from different directions. 



1 5 . (Currently amended) An obj ect extraction device^ comprising: 

a^rstaH-object extraction calculating device that repeats the-an object extraction 

calculation for eliminating an incorrect outline segment from a predetermined partial region on the 
a plurality of photographed images having parallax with respect to tk^ame-an object using a 
predetermined second calculation parameter that is different from th^fiitia^aiirsLcalculation 
parameter, and finds Ae-are-extracted *fflag^image_which is-fee^nfirisesan object extraction 
image of this-thepartial region; 

a recalculated repion determining device that detu nes the nartial r.pio n that inr.l„H~ th- 

incorrect outline segm ent as a recalculated re gion; anH 

a se cond object extraction calculating device that fi.H. a re-extr^H ,n^ e that enmnri^ 

an object extraction image of the recalculated r. P inn h v carrvinp nilt an nbiect extra . finn 
calculation in order to eliminate the inco rrect outline s egment in the r^. culated repinn hy wrinf 
the second calculation parameter on said p lu rality of p hntop rgphed images 
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1 6. (Currently amended) An object calculating device according to Claim 1 5 a wherein sai4-the 
partial region Comprises a region that includes the-an outline part determined to be an incorrect 
outline segment within the image region of the object extraction image found by carrying out the 
object extraction calculation for extraction of the object using satoit^tiiefirst.calculation 

parameter. 



1 7. (Currently amended) An object extraction device according to Claim 1 5, furttocomprising 
an image reconstructing device that reconstructs anjmageof the object extraction image by 
exchanging the image of said-thej^artial region within the object extraction image found by the 
object extraction calculation using s«d4«it^theiirsLcalculation parameter and the re-extracted 
image. 

1 8. (Currently amended) An object extraction method comprising: 

n first proc e ss that find, findjng_an object extraction image by carrying out an object 
extraction calculation for extraction theofan object, using a predetermined first calculation 
parameter on the-a_plurality of photographed images that have parallax with respect to the same 
object; 

n sor ond process that e xtracts th e extracting an outline from the object extraction image; 
found by said first process, 

n t hi rd process that e xtracts as extracting an incorrect outline th^se^menl stF*ight4i«e 
segment within from the extmcted outline ; ev tnrt od by said ,,rnn d pr nrr - lli. u h a, a l u ig I h 
exceeding a predetermined thr e shold valu e, 
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a fourth process that dotorminoa determining as the-a_recalculated region the-apartial region 
that includes the incorrect outline segmen loxtractcd by said third process within the-an image 
region of said pred e termined one of the p hotographed-knag e images : 

a fifth process that finds the findjng^_re-extracted image, which is-the -comprises an object 
extraction image i»-of the recalculated region, by carrying out an object extraction calculation for 
eliminating the incorrect outline segment in said-therecalculated region using a predetermined 
second calculation parameter that is different from said-the first calculation parameter on said-the 
plurality of photographed images; and 

a sixth process that reconstructs r econstructing an imag e of the object extraction image 
based on the object extraction image found in said first prooeas and the re-extracted image.-feuad 
in said fifth process. 

1 9. (Currently amended) An object extraction method according to Claim 1 8, wherein said third 
proc e ss finds the the incorrect outline extracting comprises finHinp an ^ part of me object from 
me Predetermined ongjafjhejhotographed image from among said plurality of photog r aph e d 
images, and extraets-extracting as afHhejncorrect outline segment either or both &e -of (a) a 
straight line segment thaijs_within the extracted outline, extracted by said second process that is-the 
comprises an outline part not included in the found edge part, and that has a length exceeding a 
predetermined first threshold value, and the-(bla.straight line segment that is-the- comprises an 
outline part that intersects the found edge part and thaLhas a length exceeding a predetermined 
second threshold value. 
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20. (Currently amended) A recording medium that stores an object extraction program that 
executes an object extraction method on a compute r, wherein said method comp rises: 

a firot process that finds finding an object extraction image by carrying out an object 
extraction calculation for extraction the-ofan object using a predetermined first calculation 
parameter on a plurality of photographed images having parallax with respect to the same-object; 

a second process that extracts extracting an outline from the object extraction image; feu*d 
by said firot procoss; and 

a third proceoo that extracts as extracting an incorrect outline the straight line segment 

withia-from the exfractgd outline; extracted bv nn ir l nnmnrl r . tw u„ n 1 ? J 1£ tfa c::ccc dinfc a 

predetermined threshold value 

determining as a recalculated region a p artial region that includes the incorrect outline 

segment within an imag e region of one of the p hot ographed imag es; 

finding a re-extracted image, which comp ri ses an object extraction imap e nf the 

recalculated region, by carrying out an object extraction calcu l ation for elimina ting the incorrert 
outline segment in the recalculated region using a predetermined calculation p ar am „t~ 

is different from the first calculat ion p a r a m ete r on the plurality of nhotop raph e d images: and 

^constructing an image of the object based on t h e object extract ion imape an H ~. 

extracted imag e. 



21. (Canceled) 
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22. (Currently amended) A recording medium that stores an object extraction program 

according to Claim 20, wherein said object extraction program further executes on a computer in 

said third process extracting the incorrect outline segment comprises : 

a process that finds the finding an edge part of the object from a predetermined 

photographed image from among said-theplurality of photographed images; and 

a process that extracts extracting as incorrect wfliaes- outline segments either or both of £a) 
a straight line segment that is-fee-comprises an outline part within the extacted_outline, extracted 
by said second process thatignot included in the found edge part, and that has a length exceeding a 
predetermined first threshold value, and {bj_a straight line segment that is^he ^omprises an outline 
part that intersects the found edge part and thathas a length exceeding a predetermined second 
threshold value. 



23 . (Currently amended) A computer medium that stores an object extraction program that 
ftffthet-executes on a computer a process, that finds the the process comprising : 

finding^re-extracted image, which ts-the -comprises an object ex*a€te^xtraction image of 

&e -a predetermined partial region, by repeating the-an object extraction calculation for eliminating 
incorrect e«aiaes-outline segments within a predetermin e d thepartial region on the-a_plurality of 
photographed images having parallax with respect to fee^affle-an object, using a predetermined 
second calculation parameter that is different from the^iritiai-afirsLcalculation parameter! 

determining the partial region that includes the in correct outline se gments as a reralmlateH 

region: and 

finding a re-extracted image that comprises an o bject extraction image of the rer.alrnlateH 

region by carrying out an object extract ion ca l c u lation in order tp eliminate the incorrect outline 
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segment in the recal culated region by using the second calculation parameter on said plurality of 
photographed images . 

24. (Currently amended) A recording medium that stores an object extraction program 
according to Claim 23* wherein said object extraction program further executes on a computer a 
process tha^further_determines in a partial region the-a_region that includes the-adetermined outline 
part as an incorrect outline segment within an image region of the object extraction image found by 
carrying out the object extraction calculation for extraction of the object using enid initial the first 
calculation parameter. 

25. (Currently amended) A recording medium that stores an object extraction program 
according to Claim 23* wherein said object extraction program further executes on a computer a 
process that-fiu^ierreconstructs an image of the object extraction image by exchanging the image 
of said-thepartial region within the object extraction image found by the object extraction 
calculation using saki-the_initial calculation parameter and the re-extracted image. 
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AMENDMENTS TO THE ABSTRACT 

The original Abstract is replaced by new Abstract attached hereto. 
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AMENDMENT TO THE DRAWINGS 

Figure 15 is amended to designate it as Background Art. 
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REMARKS 

Claims 1-5, 7-20, and 22-25 are presently pending in this application and have been 
amended to more particularly define the invention. Claims 6 and 21 have been canceled to 
expedite prosecution. 

It is noted that the claim amendments are made only to assure grammatical and idiomatic 
English and improved form under United States practice, and are not made to distinguish the 
invention over the prior art or narrow the claims or for any statutory requirements of patentability. 
Further, Applicant specifically states that no amendment to any claim herein should be construed as 
a disclaimer of any interest in or right to an equivalent of any element or feature of the amended 
claim. 

Claims 4, 15-17, 19 and 22-24 were rejected under 35 U.S.C. §112, second paragraph, with 
the contention that the claims are narrative and indefinite. This rejection is traversed. All the 
claims, including claims 4, 15-17, 19 and 22-24, have been amended to assure grammatical and 
idiomatic English. It is accordingly submitted that this rejection should be reconsidered and 
withdrawn. 

It is noted that the Office Action alleges that claim 19 recites the expression "the finding of 
edge part of the object" and that this limitation is not well written. The undersigned attorney was 
unable to locate the expression "the finding of edge part of the object" in claim 19, either as 
originally presented or as amended above. If the Examiner repeats this rejection, he is requested to 
point out the precise location within claim 19 at which the expression is found. 

Applicant gratefully acknowledges that claims 6-13 and 21 are indicated to be allowable if 
rewritten in independent form. Claim 1 has been amended to incorporate the subject matter of 
claim 6, while removing features unnecessary to patentability. Likewise, claim 20 has been 
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amended to incorporate the subject matter of claim 21 . The other amended independent claims — 
15, 18, and 23 ~ contain corresponding subject matter. Consequently, all of the independent 
claims 1, 15, 18, 20, and 23 are allowable, as are all of their respective dependent claims 2-5, 7-14, 
16-17, 19, 22, and 24-25. 

The Office Action objects to Figure 15. The Submission of Replacement Drawing Sheet 
Including Drawing Correction amends Figure 1 5 to label it as Background Art. 

The specification has been amended to correct clear errors, noting that the amendments 
cause the amended paragraphs to agree with page 15, lines 12-13 and page 17, lines 16-17. 

The Abstract has been amended to better comply with United States practice. 

In view of the foregoing, Applicant submits that claims 1-5, 7-20, and 22-25, all the claims 
presently pending in the application, are patentably distinct over the prior art of record and that the 
application is in condition for allowance. Such action would be appreciated. 

Should the Examiner find the application to be other than in condition for allowance, the 
Examiner is requested to contact the undersigned attorney at the local telephone number listed 
below to discuss any other changes deemed necessary in a telephonic or personal interview. 

To the extent necessary, Applicant petitions for an extension of time under 37 CFR §1.136. 
Please charge any shortage in the fees due in connection with the filing of this paper, including 
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extension of time fees, to Attorney's Deposit Account No. 50-0481 and please credit any excess 
fees to such deposit account. 



McGinn & Gibb, PLLC 

8321 Old Courthouse Road, Suite 200 

Vienna, VA 22182-3817 

(703) 761-4100 

Customer No. 21254 



Respectfully Submitted, 
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ABSTRACT 

An object extraction device. In an exemplary embodiment, a first object extraction 
calculating device finds an object extraction image by employing object extraction calculations for 
extraction of an object by using a predetermined first calculation parameter on photographed 
images having a parallax with respect to the object. An incorrect outline extraction processor 
extracts an outline from the object extraction image and extracts an incorrect outline segment from 
the extracted outline. A recalculated region determining device determines as a recalculated region 
a partial region that includes the incorrect outline segment. A second object extraction calculating 
device finds a re-extracted image that includes an object extraction image of the recalculated 
region, by carrying out an object extraction calculation in order to eliminate the incorrect outline 
segment in the recalculated region by using a second calculation parameter that is different from 
the first calculation parameter on the photographed images. 
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TATES PATENT AND TRADEMARK OFFICE 



In re Application of: Hiroshi Ohta 

Serial No.: 09/781,280 Group Art Unit: 2623 

Filed: February 13, 2001 Examiner: Le, Brian Q. 

For: OBJECT EXTRACTION DEVICE, OBJECT EXTRACTION METHOD, AND 

RECORDING MEDIA FOR STORING AN OBJECT EXTRACTION PROGRAM 

Honorable Commissioner of Patents 
Alexandria, VA 223 13-1450 

SUBMISSION OF REPLACEMENT DRAWING SHEET 
INCLUDING DRAWING CORRECTION 

Sir: 

Submitted herewith is a replacement drawing sheet including a proposed drawing 
correction. Figure 1 5 is amended to designate it as Background Art. 

A marked drawing having the correction in red is also attached- 
Approval and acknowledgment of receipt are respectfully requested. 

Respectfully Submitted, 



Date: 




ies N. Dresser, Esq. 
'Registration No. 22,973 
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